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ABSTRACT 

A series of studies were conducted to modify the 
General Aptitude Test Battery (GATB) and the Minnesota Importance 
Questionnaire (MIQ) for use with mentally retarded individuals. 
Modification of the GATB consisted of eliminating answer sheets, 
increasing practice, individual administration, untimed 
administration, removal of verbally loaded items, and simplifying 
test instructions and practice problems. None of these modifications 
significantly changed the test performance of the mentally retarded 
subjects. Modification of the MIQ involved rewriting the item stems 
at a readability level which was understandable to mentally retarded 
individuals. Form S, the revised 17-scale MIQ, was found equivalent 
to the standard MIQ in terms of profile similarity and, for 1 1 of 17 
scales, equivalent means and standard deviations. Individual 
differences in measured abilities and needs among the mentally 
retarded were found to approximate those of the non-mentally 
retarded. Applicability of the Theory of Work Adjustment, utilizing 
the GATB and Form S MIQ in assessing work personalities, is indicated 
for mentally retarded individuals in the borderline and, to a lesser 
extent, the mild categories. (Author) 
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Significant Findings for Rehabilitation 
(and Social Service) Workers 



1. Multifactor assessment of vocational abilities is feasible for the 
mentally retarded** The General Aptitude Test Battery (GATE) is an 
appropriate tool for this purpose and can be used without further modification. 

2. In the multifactor assessment of vocational abilities, the use 
of "wrong" scores (number of incorrectly answered items), "speed" scores 
(number of Items attempted), and "accuracy" scores (ratio of correctly 
answered items to total attempted) can yield information not given by 
conventional "right" (number right) scores. The vocational significance of 
these scores has yet to be determined, however. 

3. Form S, a revision of the Minnesota Importance Questionnaire (MIQ) 
developed in this project, can be used in the mult if act or assessment of 
vocational needs of the mentally retarded. Form S was shown to be under- 
standable to the mentally retarded and equivalent (in terms of profile 
similarity and for many scales equivalent means and variances) to the 
standard form MIQ * 

4. Individual differences in measured abilities and needs among the 
mentally retarded were observed to approximate those among the non-raent ally- 
retarded. Furthermore, the patterns of relationships among abilities and among 
needs observed for the mentally retarded were similar to those for the 
non-oent ally-retarded . A wide variety of work personality types can therefore 
be expected among the mentally retarded. A more individualized approach 

to the vocational rehabilitation of the mentally retarded than is currently 
practiced would seem to be indicated. 

5. Use of the GATB and Form S of the MIQ will enable the utilization 
of Occupational Aptitude Patterns (OAPs) and Occupational Reinforcer 
Patterns (ORPs) in the exploration of possible vocational choices for the 
mentally retarded. In such exploration, prediction of work adjustment, 

as formulated in the Theory of Work Adjustment, can be made on the basis 
of the correspondence of GATB and MIO scores with OAPs and ORPs, respectively. 
GATB-OAP correspondence can be used to predict satisfactoriness, and 
MIQ-ORP correspondence # to predict satisfaction. Hence, occupational 
possibilities can be found for which the mentally retarded would be predicted 
to be both satisfactory and satisfied. 



* "Mentally retarded" refers to individuals with IQs between 1 and 3 
standard deviations below average ox those classified as "borderline" 

or "mild". The more severely retarded mentally are not Included in 
this reference. 






2 



EDO 48716 



EC031992 



U.S. DEPARTMENT OF HEALTH. EDUCATION 
& WELFARE 
OFFICE OF EDUCATION 
THIS DOCUMENT HAS BEEN REPRODUCED 
EXACTLY AS RECEIVED FROM THE PERSON OR 
ORGANIZATION ORIGINATING IT. POINTS OF 
VIEW OR OPINIONS STATED DO NOT NECES- 
SARILY REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY 



Assessing the Work Personalities 
of Kentally Retarded Adults 

RD-2568-P 



Final Report 
September 1970 



Principal Investigators 

Lloyd H. Lofquist 
Rene V. Bawis 






•3 f 



Research Coordinator 



Bavid J. Weiss 



Department Of Psychology 
University of Minnesota 
Minneapolis, Minnesota 55455 



This research is supported, in part, by Research Grant 
M.O* RD-2568-P from the Division of Research and Demonstration 
Grants, Social and Rehabilitation Service, Department of Health, 
Glucation and Welfare, Washington, D.C., 20201 



(i) 



3 



Acknowledgments 



|erjc 



The principal investigators acknowledge the contributions of the following 
individuals and institutions in the conduct of the present investigation and 
the preparation of the final report: 

John Buchanan, Dwight Kauppi and Kevin Murphy, Research Fellows, contributed 
to the overall planning and conduct of the research. 

Research Assistants Sandra Davis, John BeSfitt, Jay Eisenberg, Margaret 
Elo, Steven Flamer, Bonnie Gray, Patricia Hart in, Ronald Katross, T.W. Hiller, 
Judith Nitardy, Courtney Peterson and Stuart Rosen, provided assistance in 
the data collection and data analysis phases of this investigation. 

The following Hinnesota agencies cooperated in providing subjects for 
the studies conducted as part of this investigation: Anoka Work Adjustment 

Center, Cedar Valley Rehabilitation Workshop (Austin), Community Work and 
Development Center of the Iron Range (Virginia), Cooperative School 
Rehabilitation Center, Duluth Sheltered Workshop, Goodwill Industries (Duluth), 
Jewish Vocational Workshop (Minneapolis) , Lake Region Sheltered Workshop 
(Fergus Falls), Mankato Sheltered Workshop, Minneapolis Goodwill Industries, 
Minnesota Division of Vocational Rehabilitation, Occupational Training Center 
(St. Paul), Opportunity Workshop (Minneapolis) , Outreach (Minneapolis), 

Rochester Ability Building Center, St. Paul Goodwill Industries, St. Paul 
Rehabilitation Center, United Cerebral Palsy (Minneapolis), West Central 
Industries (Willmar) and Worthington Workshop. 

Mattie Westberry, Charlene Powell and Lora Hack served as keypunch 
operators and Bobbie Johnson;, Debra Polk and Darlene Baden served as the 
clerical staff for this project. 

The investigators acknowledge the cooperation of the University of 
Minnesota Numerical Analysis Center for providing computer facilities , the 
Psychology Department at the University of Minnesota for access to the subject 
pool from which student samples were selected and Darwin Hendel in the 
preparation of this final report. 



4 

(ii) 



I 



Table of Contents 



Page 



Acknowledgments 11 

Abstract ...... Iv 

Introduction 1 

Background . . 1 

Statement of the problem 2 

Review of relevant literature 3 

Organization of this report 4 

Methodology 6 

GATB Study 1 12 

GATB Study 2 .24 

GATB Study 3 . .' 34 

GATB Study 4 38 

MIQ Study 1 46 

HIQ Study 2 57 

MIQ Study 3 62 

MIQ Study 4 66 

MIQ Study 5 69 

MIQ Study 6 72 

MIQ Study 7 .... 75 

MIQ Study 8 80 

Summary of Results 89 

Discussion and implications 93 

Summary 98 

References 102 

Appendixes 105 




(ill) 



5 



Abstract 



A series of studies were conducted to modify the General Aptitude 
Test Battery (GATB) and the Minnesota Importance Questionnaire (MIQ) 
for use with mentally retarded individuals. Modification of the GATB 
consisted of eliminating answer sheets, increasing practice, individual 
administration, untimed administration, removal of 'Verbally loaded" 
items, and simplifying test instructions and practice problems. None 
of these modifications changed significantly the test performance of the 
mentally retarded subjects. Modification of the MIQ involved rewriting 
the item stems at a readability level which was understandable to mentally 
retarded individuals. Form S, the revised 17-scale MIQ, was found equivalent 
to the standard MIO in terms of profile similarity and, for 11 of 17 
scales, equivalent means and standard deviations. Individual differences 
in measured abilities and needs among the mentally retarded were found 
to approximate those of the non-mentally retarded. Patterns of relation- 
ships among abilities and among needs for the mentally retarded were similar 
to those of the non-mentally retarded. Applicability of the Theory of 
Work Adjustment, utilizing the GATB and Form S MIQ in assessing work 
personalities, is indicated for mentally retarded individuals in the 
"borderline" and, to a lesser extent, the "mild" categories. 
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Introduction 



Background 

Project Grant No. RD •* 2568 - P, entitled :: Assesslng the Work Personalities 
of Mentally P.etarded Adults", with Professors Lloyd H. Lofquist and Rene V. 

Pawis of the University of Minnesota as principal investigators,** was initiated 
on July 1, 1967 and completed on June 30, 1970. This project had its origins 
in the implications that the Theory of Work Adjustment (Dawis, England & Lofquist, 
1964? Davis, Lofquist & Weiss, 1968) had for disability and work. In a 
monograph under this title (Disability and Work . Lofquist et al., 1964); it was 
stated that: 

‘’Proceeding from (the Theory of Work Adjustment), the approach to 
disability and work . ..is based on the premise that, for purposes of 
vocational rehabilitation counseling, a discussion of the influence of a 
disabling condition is more meaningful when emphasis is placed on the effect 
of the trauma in job-relevant abilities. This includes the effect of the 
trauma on an individual's vocational needs when changes in needs are accompanied 
by significant changes in job-relevant abilities. These statements suggest 
that describing the impact of a disabling condition on an individual in work- 
adjustment terms may not be the same as describing it in medical diagnostic 
terms.” (p.3) 

Elsewhere in the same monograph, the authors list the study of the work 
personalities of mentally retarded* Individuals as an important research 
problem: "The individual differences in the abilities and needs of mentally 

retarded individuals should have significance for work adjustment. The 
mentally retarded individual, just as the normal Individual, has a unique 

work personality, and his own work adjustment possibilities.” (Lofquist, et 

^Professor George W. England was a third principal investigator during 
the first project year (1967-68), 
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al., 1964, p. 10). 

Statement of the Problem 

The basic objective, then, of this project was to make a contribution 
to work personality assessment of adult mentally retarded individuals. 
Specifically, in the context of the Theory of Work Adjustment, this objective 
translated to the assessment of the work-relevant abilities and needs of 
mentally retarded individuals. The basic premise, to reiterate, was that 
individual differences in abilities and needs exist among even mentally 
retarded Individuals, to the degree that it would be advantageous to 
capitalize on such individual differences in dealing with the adjustment to 
work of these individuals. This premise, it should be noted, runs counter to 
the stereotypy that commonly prevails in current thinking about work 
possibilities for the mentally retarded. It is the viewpoint of this project 
that knowledge of individual differences in work-relevant abilities and needs 
of mentally retarded persons cannot but enlarge the range of work adjustment 
possibilities for such persons beyond the pitifully narrow range now available 
or even considered appropriate. 

In planning for the project, it was felt that a desirable goal would be 
to develop the tools which would enable the utilization of the predictive model 
implicit in the Theory of Work Adjustment. This model makes use of the concept 
of correspondence between work personality and work envlrbnment as the key 
predictor of work adjustment. From this point of view, two of the most 
useful descriptions of the work personality currently available are the 
United States Employment Service's General Aptitude Test Battery (GATB) and 
The Work Adjustment Project's Minnesota Importance Questionnaire (MIQ). These 
instruments are useful because of the large number of jobs described in GATB 
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terms as Occupational Aptitude Patterns (OAPs; D.S. Department of Labor, 

1966) and In MIQ terms as Occupational Relnforcer Patterns ( ORPs; Bor gen, 
et al. , 1968). Thus, It was reasoned, if instruments equivalent to the GATB 
and the MIQ could be developed for the mentally retarded, this vould allow 
utilization of the existing OAP - ORP technology In the assessment of work 
adjustment possibilities for mentally retarded persons. 

The specific problem, then, to which the project was addressed, was: 

Can such instruments be developed for use with mentally retarded individuals 
that can yield work personality information equivalent to the GATB and the 
MIQ? Because of the tremendous time and resources necessary to undertake 
development of an ability test battery such as the GATB, it was decided to 
attempt to modify or reconstruct the GATB Itself for use with the mentally 
retarded. A less ambitious, but nevertheless expensive and difficult, 
undertaking decided on was the construction of an MIQ form that would be 
understandable to mentally retarded individuals and at the same time 
equivalent (in information yield) to the regular MIQ. 

Review of the Relevant Literature 

Most studies on the mentally, retarded, when discussing their vocational 
abilities, take one of two extremes: discussion is confined to either IQ 

(general intelligence) assessment or specific work skills (at in workshop » 
or work sample evaluations). The middle ground of multiability or multiaptitude 
assessment is rarely touched. A singular exception is Tizard, O'Connor and 
Crawford's (1950) study of GATB performance by 104 adolescent and adult 
"high grade mental defectives". 

Besides studies using IQ (which remains the single best predictor of job 
success; see McNemar, 1964, and Ghiselli, 1955), other studies on the mentally 
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retarded have Included the assessment of finger dexterity (Cantor & Stacey, 

1951 ; Clausen, 1966; Tobias & Gore lick, 1960; Elkin, 1967; Wagner & Hawver, 1965; 

and Pamicky & Kahn, 1963); manual dexterity (Murray , 1956; Cantor, 1960; 

Wagner & Hawver, 1965; and Distefano, Ellis & Sloan, 1958); spatial relations 

(Page, 1933; Murray, 1956; and Tizard & Loos, 1954); and mechanical ability 

(Frandsen, 1935; Pamicky & Kahn, 1963; and Elkin, 1967). As the preceding 
listing indicates, studies on the vocational abilities of mentally retarded 
individuals are meagre in number. More studies have been published on their 
physical abilities (e.g., static strength, strength of grip, running speed, 
beam walking, and even reaction time), but rarely, if at all, were the findings 
reported in a vocational context. Studies concerning workshop and work 
sample evaluations (e.g., Kelstoe, 1961 | Appel, Williams & Fishell, 1962; 

Tobias, 1960; and Ladas, 1961) were seen by s .a as the most promising 
avenue to the vocational assessment of mentally retarded individuals, but 
the limitations of such evaluations have since become apparent (Saikata & 

Sinick, 1965). Besides being quite expensive, they have demonstrated little 
validity for vocational prediction beyond that attainable by less expensive 
ability testing. This discouraging result may in part be due to the un- 
standardized and unsystematic manner in which such evaluations are carried out 
and, in turn, evaluated. 

The literature on the topic of vocational needs of mentally retarded 
individuals is even more meagre than that on vocational abilities. Pamicky 
and Kahn (Pamicky & Kahn, 1963; Pamicky, Kahn & Burdett, 1965), in a major 
effort at developing a vocational interest measure for use specifically with 
this population, constructed a picture inventory of jobs representing seven 
occupational areas in the men's form and five occupational areas in the 
women's form. The Geist Picture Interest Inventory (Geist, 1959) has been 
used with mentally retarded individuals (Magary, 1961). Interviews were 
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used to get at vocational preferences by Cohen & Rusalem (1964) and Erdman 
(1957) and Gorelick (1966, 1967). 

As the preceding review of the literature indicates, knowledge about 
the work personalities of mentally retarded individuals is rather limited and 
in need of much more research. 

Organization of this Report 

, r > 

This Final Report is organized into seven parts: 1) Introduction, 

2) Methodology, 3) Summary of Results, 4) Discussion and Implications, 

5) Summary, 6) References, and 7) Appendixes. The major portion of the report 
is found in the Methodology part. Because this project consisted of a series 
of separate experiments and studies, the Methodology part is org. : id around 

the separate studies. There are two groups of studies reported, GATB studies 
and MIQ studies, highlighting the focus of this project on these two 
instruments. Each study is reported in its entirety, the study report consisting 
of three sections: Purpose, Method, and Results, with the Method section 

generally further subdivided into four subsections (Subjects, Instruments, 
Experimental Design, and Analysis)-. The individual study results are integrated 
in the Summary of Results part. All other parts of the report follow closely 
the Guide for Preparing Final Reports (1968). 
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Methodology 

A series of studies. Pome of them experimental and others of the field 
type, was undertaken with two major objectives in mind: (1) to modify the 
GATB for use with the mentally retarded; and (2) to develop an HIO form 

t 

that was understandable to the mentally retarded and at the same time 
equivalent (psychoraetrically) to the regular MIQ. 

Four studies were conducted in connection with the first objective. 
These are reported under the following headings: 

GATB Study 1. 

GATB Study 2. 

GATB Study 3. 

GATB Study 4. 



Answer sheet and practice effects on ability test 
performance 

Group vs individual and speeded vs non-speeded administration, 
and ability test performance 

Influence of verbal loading on ability test performance 
Difficulty of instruction and practice, and ability test 
performance . 



Eight separate studies were conducted in pursuit of the objective of 
developing an MIQ for use with the mentally retarded. These are reported as: 
MIQ Study !. Item development 

MIQ -Stu^y 2. Estimation of item.understandability 

MIQ Study 3. Equivalence of Form M and Form P 

MIQ Study 4. Wording revision of nine scales 

MIQ Study 5. Equivalence of Form M, Form MRev and Form P 

MIQ Study 6. Understandability of Form K, Form MRev and Form P 

MIQ Study 7. Construction of Form S 

MIQ Study 8. Equivalence of Form S and Form P 
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Each of the GATB and MIQ studies is reported separately as a complete 
study, i*e., with Its own Purpose, Method, and Results section. The Method 
section of each study is further subdivided into subsections for Subjects, 
Experimental Design (for experiments) or Procedure (for field studies) and 
Analysis. 

Before proceeding with these individual study reports, the groups of 
mentally retarded subjects participating in these studies deserve more 
detailed description. 

The mentally retarded subjects in these studies came from two 
different population sources. One subject source was the sheltered 
workshops in Minnesota. Individuals in these sheltered workshops are 
described as ’’functionally retarded." Subjects from a few sheltered 
workshops participated in more than one study. The largest single group 
of sheltered workshop subjects participated in GATB Study A (N ** 167). 

These individuals were located in seven sheltered workshops throughout 
the state and appeared to be representative of the total group of sheltered 
workshop subjects. 

IQ scores were available for 122 of these 167 individuals. Since these 
scores were obtained from different intelligence tests ,*• scores were converted 
to T~scores (mean ° 50, SD * 10) using developmental means and standard 
deviations. Where a number of scores were available for a single individual, 
only the highest T- score was recorded. Table 1 shows the distribution of 
IQ and 10 T-score for these 122 mentally retarded subjects. Categorization 
according to the official terminology of the American Association on 

Mental Deficiency is also included. 

1 Among the tests used as sources of IQ information were ; Stanford- 
Binet Intelligence Scale, Wechsler Adult Intelligence Scale, Wechsler- 
Bellevue Intelligence Scale, Wechsler Intelligence Scale for Children, Otis 
Quick-Scoring Mental Ability Tests, California Test of Mental Maturity, Lorge- 
Thomdike Intelligence Tests, Peabody Picture Vocabulary Test, Army General 
Classification Test, and the Ammons and Ammons Quick Test. 
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Table 1 

Distribution of mentally retarded subjects from sheltered 
workshops , by classification, IQ, T-score, and sex 





Classification 


IQ 


IQ T-Score 


Number 

Male Female 





85 & up 


40 & up 


12 


8 


Borderline 


70t84 


30.0-39.9 


16 


19 


Mild 


55-69 


20.0-29.9 


20 


25 


Moderate 


40-54 


10.0-19.9 


7 


15 


Severe 


25-39 


0.0-9. 9 






Profound 


25 


0.0 






Total Number 






55 


67 


Mean (IQ T-score) 




30.7 


27.7 


SD (IQ T-score) 




11.3 


9.0 



a From Heber, R. Modifications in the manual on terminology and 
classification in mental retardation. American Journal of 
Mental Deficiency , 1961, 65, 499-500. 
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As Table 1 indicates » two- thirds of the subjects can be categorized 
as ’mild' or '‘borderline 5, . About one'- sixth (16%) actually had IQs within 
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the normal range (IQ 85 and up). The remaining individuals, slightly 
more than one-sixth, were classified as "moderate". Average IQ was 
approximately 2 SDs below the mean, k sex difference in average IQ 
T-score was observed (P * .01) , with the females having the lower average IQ. 

The second subject source was the Minnesota Division of Vocational 
Rehabilitation (MBVP.) , which had contracted with the Fork Adjustment Project 
for a continuing program of testing and vocational assessment of its clients. 
DVR clients referred to the Fork Adjustment Project are administered the 
GATB, the MIQ, the Strong Vocational Interest Blank, the Minnesota 
Vocational Interest Inventory, the Minnesota Multiphasic Personality Inventory 
and the Gates Reading Tests. Some of the DVR clients are classified as 
"mentally retarded" (based on a variety of information, e.g., school records, 
IQ tests, institutional history, etc.). Many of these mentally retarded 
DVR clients participated as subjects in several of the studies. Table 2 
presents data on the GATB test performance of these subjects and comparative 
data for non-retarded DVR clients who were also referred to the Work 
Adjustment Project for testing, as well as the GATB general working population 
norms for the same tests. 

Table 2 shows that the DVR retarded sample had test means which were 
usually 1 to 1 1/2 SDs below the general working population mean. Exceptions 
to this observation include the means for Arithmetic Reasoning, Mark 
Making, Place, Turn and Disassemble, for which the DVR retarded sample’s 
means were about 2 SDs below the general working population mean. (In 
contrast, the DVR non-retarded group had test means equivalent to those of 
the general working population, except for the dexterity tests on which 
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Table 2 

Means and standard deviations of 6ATB B-1002B: test scores 
for DVR retarded, DVR non-retarded and 6ATB norm groups, by tests 





DVR retarded a 


DVR non-retarded 


GATB C 


norm 


GATB Test 

9 


X 


SD 

• 


X 


SD 


X 


SD 


1. Name Comparison 


25.1 


11.4 


42.1 


14.4 


43.7 


15.9 


2 . Computation 

3. Three-Dimensional 


8.9 


5.6 


20.3 


6.2 


23.1 


6.7 


Space 


9.1 


5.2 


17.4 


5.8 


16.8 


6.5 


4 . Vocabulary 


7.0 


4.7 


19.0 


8.4 


19.1 


10.1 


5 . Tool Matching 

6 . Arithmetic 


19.7 


7.7 


24.9 


7.3 


29.1 


6.6 


Reasoning 


4.2 


3.0 


10.7 


3.4 


11.4 


3.5 


7. Form Matching 


15.3 


5.9 


23.6 


7.9 


23.9 


6.9 


8 . Mark Making 


49.0 


13.0 


63.2 


11.7 


69.5 


10.3 


9. Place 


73.7 


14.0 


81.9 


12.7 


89.8 


8.6 


10. Turn 


79.8 


12.3 


88.9 


12.4 


100.8 


9.6 


11 . Assemble 


21.7 


6.7 


25.4 


5.2 


28.3 


4.6 


12 . Disassemble 


21.4 


3.4 


25.5 


5.2 


29.5 


3.7 



&N**53 except for Vocabulary and Arithmetic Reasoning (for both of which N*34) 

t>N»50 Both DVR groups (retarded and non-retarded) consisted of clients who were 
referred to the Work Adjustment Project for testing and vocational 
assessment. 

C N"4,000 (the 6ATB General Working Population Sample). See U.S. Department of Labor, 
Bureau of Employment Security. Guide to the use of the General Aptitude 
Test Battery , 1962, pp. 23, 25. 
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the DVR non-retarded test means were lover.) The DVR retarded sample had 
a higher average IQ than the previously described sheltered workshop sample 
of mentally retarded individuals, the difference between the two samples 
was about one-half standard deviation. 

The data in Tables 1 and 2 are given to Obviate the necessity of 
describing each sample of mentally retarded individuals participating in 
each of the 12 studies reported on the following pages. Instead, the source 
of the mentally retarded subjects is given for each study. 

A final question that may be raised about the mentally retarded subjects 
concerns the choice of these particular populations (sheltered workshop and 
DVR). These populations were chosen for study since this particular project, 
an outgrowth of the Work Adjustment Project, focused on work and work adjustment; 
therefore, that segment of the mentally retarded population that had work 
potential and/or was vocationally rehabilitable was of primary interest. It 
is, of course, conceded that ’'work potential" and "vocational rehabilitability" 
are matters of degree and not of kind. This point is reflected in the 
range of ability — and of vocational needs--to be found in the groups of 
mentally retarded subjects in the different project studies. 
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GATB Study 1 



Answer sheet and practice effects on ability test performance 
Purpose 

A study was designed to examine the effects of two test format variables 
upon the performance of persons of various ability levels. The two test 
format variables were: 1) the use of a separate answer versus no separate 

answer sheet; and 2) the use of a standard number of practice problems 
versus double the standard number of practice problems. 

It was hypothesized that the elimination of separate answer sheets would 
help persons to answer more Items correctly and fewer Items Incorrectly. It 
was also hypothesized that elimination of separate answer sheets would help 
mentally retarded individuals more than non-retarded individuals. With regard 
to practice problems, it was hypothesized that increasing the number of 
practice problems would help persons to answer more items correctly and 
fewer items incorrectly. Such modifications in test format were hypothesized 
to aid mentally retarded individuals, more than others . 

Method 

Subjects — Four groups of subjects, representing four levels of general 
ability, participated in the study: (a) 68 mentally retarded (MR) persons 

from two sheltered workshops; (b) 137 high school (HS) students enrolled in 

mechanical arts curricula; (c) 77 General College (GC) students in 

introductory psychology classes; and (d) 38A College of Liberal Arts (CLA) 
students in Introductory psychology classes. 

Instrument >r -rF our GATB B-1002B tests were used in the present study: 

Marne Comparison, Computation, Vocabulary, Tool Matching. Each of the tests 
was administered in the standard , item sequence and under standard time limits. 



Standard instructions were used in all experimental conditions, with some 
slight modification when IBM answer sheets were not used. 
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Experimental design- - Subjects from each of the four ability groups were 
assigned at random to one of four experimental conditions: (a) No extra 

practice with separate answer sheet; (b) No extra practice with no separate 
answer sheet; (c) Extra practice with separate answer sheet; and (d) Extra 
practice with no separate answer sheet. Once assigned to a given experimental 

condition, a subject received all four GATB tests under that experimental 
condition. 

Instructional and practice problems for no-extra-practice conditions were 
as given in the GATB tssts. For extra-practice conditions, standard GATB 
instructional and practice problems were kept in their original order and 
a like number of extra practice problems of similar difficulty were added 
at the end of the standard practice problems. That is, the number of practice 
problems was doubled for the extra-practice conditions. 

The standard IBM answer sheet was employed in two experimental conditions. 
Standard GATB instructions were left unchanged for these conditions. The 
two no-answer-sheet conditions, on the other hand, involved a slight 
modification of test Instructions. These conditions required examinees to 
answer items by circling response alternatives in the test booklet. 

Analysis— Right scores and wrong scores were used as two separate 
dependent variables. An individual's right score for a given test was the 
total number of items he answered correctly; his wrong score was the total 
number of items he answered incorrectly. 
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The two independent variables— the number of practice problems (no extra 
practice versus extra practice) and answer sheet (separate answer sheet 
versus no separate answer sheet) — constituted fixed, completely crossed 
factors for a 2 x 2 analysis of variance, which was run for each GATB test 
and each ability group. In addition to these analyses, 2x2x3 analyses 
of variance were run, using ability level as a classification (blocking) 
variable. It should be pointed out that these 3-way analyses were not 
entirely legitimate since it was impossible to assign subjects at random 
to ability groups. 

Results 

Right and wrong score means and standard deviations for the four experimental 
conditions, four GATB tests, and four ability groups are given in Tables 

3 and 4. 

Table 3 shows that the MR group invariably had the lowest mean right score 
for any GATB test under any experimental condition. However, it often was 
as variable within the group as the three other groups. The MR group was 
the least variable of the four groups for the Vocabulary test (in 3 of the 

4 experimental conditions) and for the Name Comparison test for the no-extra- 
practico conditions. Otherwise, it is worth noting that the spread of 
individual differences for the MR group on the three non-verbal sub tests 

was as large as that for the other groups. 




Table 4 shows some interesting results. The MR group had the (expected) 
highest mean wrong score in only 8 of the 16 possible instances. The HS 
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group had the highest mean wrong score in 5 instances and the GC group in 
3 instances. In 10 of 16 instances, the MR group was the most variable. 



15 



Table 3 

Right score means and standard deviations 
by treatment combination 



GATB Test 


Answer 


No Extra Practice 
Sheet No Answer Sheet 


Extra Practice 

Answer Sheet No Answer Sheet 


X 


SD 


X 


SD 


X 


SD 


X 


SD 


MR Group 


(N-19) 


(N-16) 


(N-17) 


(N-16) 


Marne Comparison 


25.7 


6.97 


32.4 


11.82 


32.3 


17.38 


30.5 


13,42 


Computation 


12.8 


4.17 


15.6 


7.35 


14.8 


5.82 


14.1 


6.3$ 


Vocabulary 


9.7 


5.06 


7.1 


3.28 


8.4 


4.01 


8.2 


3.82 


Tool Matching 


21.0 


7.51 


23.1 


9.51 


23.8 


6.85 


26.1 


8.11 


HS Group 


(N-31) 


(N-32) 


(N-38) 


(N-36) 


Name Comparison 


48.9 


13.72 


53.3 


11.95 


49.2 


8.00 


60.2 


16.23 


Computation 


23.3 


6.32 


19.0 


5.72 


23.7 


4;35 


23.0 


5.82 


Vocabulary 


22.2 


8.93 


14.0 


4.94 


21.4 


6.66 


19.8 


7.51 


Tool Matching 


31.4 


8.66 


35.7 


5.44 


32.8 


7.33 


35.9 


6.31 


GC Group 


(N-19) 


(N-17) 


(N*24) 


(N*17) . v 


Name Comparison 


49.1 


12.73 


60.8 


14.04 


56.8 


11.15 


71.0 


it 52 


Computation 


24.6 


2.87 


27.7 


4.97 


26.6 


5.43 


29.0 


5\7s 


Vocabulary 


20.9 


2.88 


28.9 


7.72 


23.7 


4.37 


26.1 


5.94 


Tool Matching 


32.5 


4.86 


34.2 


5.22 


35.0 


5.47 


39.4 


6.63 


CLA Group 


(N-93) 


(N-100) 


(N«90) 


(N-92) 


Name Comparison 


64.2 


13.26 


85.3 


16.03 


64.8 


11.59 


84.2 


16.32 


Computation 


28.8 


4.68 


33.2 


4.93 


29.7 


4.46 


32.4 


4.77 


Vocabulary 


31.0 


5.87 


33.7 


9.67 


31.7 


5.14 


36.0 


6.83 


Tool Matching 


36.4 


6.32 


40.4 


5.92 


34.8 


5.23 


39.8 


6.10 



o 
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Table A 

* 

Wrong score neans and standard deviations 
by treatment combination 

i 



GATB Test 


No Extra 1 


Practice 


;r Sheet 


Answe: 


Extra Practice 


er Sheet 


Answer 


Sheet 


No Answ€ 


r Sheet 


No Answ 


X 


SD 


X 


SD 


X 


SD 


X 


SD 


MR Group 


(N-19) 


(N-16) 


(N*17) 


(N*16) 


Maine Comparison 


6.7 


6.76 


12.1 


14.52 


3.7 


2.52 


5.1 


3.40 


Computation 


4.7 


3.48 


3.8 


2.67 


2.6 


3.16 


3.9 


3.21 


Vocabulc :ry 


10.5 


7.71 


13.4 


12.14 


9.4 


6.32 


10.5 


9.95 


Tool Matching 


4.1 


5.66 


3.4 


6.03 


1.8 


1.92 


1.4 


1,36 


H*> Group 


(N*31) 


(N»32) 


(N-38) 


(N-36) 


Name Comparison 


3.7 


2.94 


5.0 


5.39 


3.3 


2.69 


4.4 


3.32 


Computation 


2.6 


2.16 


4.8 


4.42 


3.0 


2.30 


3.3 


3.63 


Vocabulary 


7.3 


3.64 


19.0 


8.73 


10.3 


6«09 


17.5 


7.16 


Tool Matching 


1.7 


2.96 


1.8 


1.37 


2.7 


4.99 


1.3 


. 1.66 


GC Group 


(N*19) 


(N*17) 


(N«24) 


(N«17) 


Marne Comparison 


4.3 


3.94 


3.7 


3.53 


3.8 


3.47 


4.6 


3.47 


Computation 


2.2 


1.96 


2.3 


1.93 


3.0 


2.03 


2.5 


1.91 


Vocabulary 


7.4 


4.09 


13.7 


6.62 


9.5 


4.95 


15.6 


6.86 


Tool Matching 


2.6 


3.53 


1.9 


1.89 


1.8 


1.79 


1.8 


1.95 


CLA Group 


(N-93) 


(N*1Q0) 


(N»99) 


(N a 92) 


Name Comparison 


3.7 


4.83 


5.6 


5.33 


3.1 


2.72 


4.0 


3.30 


Computation 


2.1 


1.51 


2.3 


1.84 


1.8 


1.51 


2.6 


1.99 


Vocabulary 


7.3 


4.29 


10.9 


5.24 


6.1 


3.55 


11.2 


5.17 


Tool Matching 


2.0 


2.08 


1.8 


2.20 


1.4 


2.02 


1.4 


2.31 



t; 
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indicating that the wrong score might be an important piece of psychometric 
information. 

Tables 5 and 6 summarize . the results of the two-way analyses of variance 
conducted on the data for the HR. group. It can be seen that, except for 
the practice factor on the Name Comparison .subtest, using wrong score as 
the dependent variable, no significant results were obtained. It is safe 
to conclude that, with respect to present 6ATB test materials, the use of 
extra practice problems or the elimination of separate answer sheets has no 
appreciable effect on the test performance of mentally retarded persons. 

In contrast, extra practice and the elimination of separate answer sheets 
made a significant difference for the three other groups (CLA, GC, and HS). 

(For reasons of conciseness and economy, the ANOVA tables for these groups 
are not included in this report.) The same finding is reflected in Tables 
7 and 8, which summarize the results of the three-way analyses of variance. 

For the right score analysis (Table 7), ability level (alone and in 
interaction with the other.' factors) stands out as the single most significant 
factor in the analysis. This is not quite the case for the wrong score analysis 
(Table 8). However, even Table 8 shows the pervasive influence of the ability 
factor. These results support the conclusion that extra practice and elimination 
of separate answer sheets may benefit non-men tally retarded groups but are 
of no demonstrable advantage to the mentally retarded. 

Table 9 shows the intercorrelation of the GATB tests for the right and wrong 
scores, for the four ability groups. It should be noted how similar these 
inter cor relations are, in magnitude, direction and pattern for the different 
groups including the group. Thus, one might infer that the patterning of 
abilities (or alternatively, the ability domain structure) for HR*s is similar 
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Table 5 



Two-way analyses of variance; 

Right scores as the dependent variable, for the mentally retarded group 



Narte Comparison 

Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


90.26 


1 


90.26 


0.55 


Answer Sheet (AS) 


101.81 


1 


101.81 


0.62 


P x AS 


305.18 


1 


305.18 


1.86 


Error 


10505.15 


64 


164.14 




Total 


11002.40 


67 






Computation 










Source of variation 


SS 


DP 


MS 


F 


Practice (P) 


0.96 


1 


0.96 


0.03 


Answer Sheet (AS) 


18.14 


1 


18.14 


0.51 


P x AS 


51.08 


1 


51.08 


1.44 


Error 


2263.09 


64 


35.36 




Total 


2333.27 


• 67 






Vocabulary 










Sourde of variation 


SS 


DF 


MS 


F 


Practice (P) 


0.18 


1 


0.18 


0.01 


Answer Sheet (AS) 


32.85 


1 


32.85 


1.92 


P x AS 


25.52 


1 


25.52 


1.49 


Error 


1097.36 


64 


17.15 




Total 


1155.91 


67 






Tool Matching 










Source of Variation 


SS 


DF 


MS 


F 


Practice (P) 


143.12 


1 


143.12 


2.23 


Answer Sheet (AS) 


87.09 


1 


87.09 


1.36 


P x AS 


0.14 


1 


0.14 


0.00 


Error. 


4107.51 


64 


64.18 




Total 


4337.86 


67 
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Table 6 

Two-way analyses of variance: 



Wrong scores as the dependent variable, for the mentally retarded group 



Name 'Comparison 



Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


435.89 


1 


435.89 


6.55* 


Answer Sheet (AS) 


195.76 


1 


195.76 


2.94 


P x AS 


66.75 


1 


66.75 


1.00 


Error 


4260.25 


64 


66.57 




Total 


4958.65 


67 






Computation 










Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


15.40 


1 


15.40 


1.54 


Answer Sheet (AS) 


0.73 


1 


0.73 


0.07 


P x AS 


22.05 


1 


22.05 


2.20 


Error 


640.16 


64 


10.00 




Total 


678.34 


67 






Vocabulary 










Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


67.65 


1 


67.65 


0.80 


Answer Sheet (AS) 


69.44 


1 


69.44 


0.82 


P x AS 


14.88 


1 


14.88 


0.18 


Error 


5402.79 


64 


84.42 




Total 


5554.76 


67 






Tool Watching 










Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


75.51 


1 


75.51 


3.99 


Answer Sheet (AS) 


4.27 


1 


4.27 


0.23 


P x AS 


0.52 


1 


0.52 


0.03 


Error 


1209.69 


64 


18.90 




Total 


1289.99 


67 







* Probability of rejecting null hypothesis .05 



o 
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Table 7 

Three-way analysis of variance: 
Eight scores as the dependent variable 



Name Comparison 



Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


1421.49 • 


r 1 


1421.49 


7.53** 


Answer Sheet (AS) 


12369.51 


1 


12369.51 


65.50** 


Ability Level (AL) 


138707.21 


3 


46235.74 


244.84** 


P x AS 


2.-18 


1 


2.18 


.01 


P x AL 


1488.38 


3 


496.13 


2.63* 


AS x AL 


7202.51 


3 


2400.84 


12.71** 


P x AS x AL 


767.46 


3 


255.82 


1.35 


Error 


122745.19 


650 


188.84 




Total 


284703.93 


665 






Computation 






• 




Source of Variation 


SS 


DF 


MS 


F 


Practice (P) 


112.99 


1 


112.99 


4.44* 


Answer Sheet (AS) 


156.33 


1 


156.33 


6.14* 


Ability Level (AL) 


20187.19 


3 


6729.07 


264.34** 


P x AS 


7.82 


1 


7.82 


.31 


P x AL 


140.24- 


3 


46.75 


1.84 


AS x AL 


948.83 


3 


316*28 


12.42** 


P x AS x AL 


.213.67 


3 


71.22 


2.80* 


Error 


16546.62 


650 


25.46 




Total 


38313.69 


665 






Vocabulary 










Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


97.17 


1 


97.17 


2.16 


Answer Sheet (AS) 


33.15 


1 


38.15 


.85 


Ability Level (AL) 


46029.75 


3 


15343.25 


341.20** 


P x AS 


41.88 


1 


41.88 


.93 


P x AL 


114.35 


3 


38.12 


.85 


AS x AL 


2161.83 


3 


720.61 


16.02** 


P x AS x AL 


442.65 


3 


147.55 


3.28* 


Error 


29229.49 


650 


44.97 




Total 


78155.27 


665 






Tool Matching 










Sdurce of variation 


SS 


DF 


MS 


F 


Practice (P) 


273.35 


1 


273.35 


6.80** 


Answer Sheet (AS) 


1206.51 


1 


1206.51 


30.03** 


Ability Level (AL) 


12145.10 


3 


4048.37 


100.76** 


P x AS 


13.06 


1 


13.06 


.33 


P x AL 


546.52 


3 


182.17 


4.53** 


AS x AL' 


93.08 


3 


31.03 


.77 


P x AS x AL 


50.18 


3 


16.73 


.42 


Error 


26116.63 


650 


40.18 




Total 


40444.43 


665 







* Probability of rejecting null hypothesis £. .05 

** Probability of rejecting null hypothesis .01 
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Table 8 

Three-way analysis of variance: 
Wrong scores as the dependent variable 
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Name Comparison 



Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


279.06 


1 


279.06 


13.24** 


Answer Sheet (AS) 


244.01 


1 


244.01 


11.57** 


Ability Level (AL) 


470.20 


3 


156.73 


7.43** 


P x AS 


23.74 


1 


23.74 


1.13 


P x AL 


307.71 


3 


102.57 


4.86** 


AS x AL 


101.37 


3 


33.79 


1.60 


P x AS x AL 


67.76 


3 


22.59 


1.07 


Error 


13703.99 


650 


21.08 




Total 


15197.84 


665 






Computation 










Source of variation 


SS 


m. 


MS 


F 


Practice (P) 


6.40 


1 


6.40 


1.20 


Answer Sheet (AS) 


20.44 


1 


20.44 


3.85* 


Ability Level (AL) 


239.95 


3 


79.98 


15.06** 


P x AS 


0.26 


1 


0.26 


0.05 


P x AL 


25.03 


3 


8.34 


1.57 


AS x AL 


30.84 


3 


10.28 


1.94 


P x AS x AL 


64.26 


3 


21.42 


4.03** 


Error 


3451.32 


650 


5.31 




Total 


3838.20 


665 






Vocabulary 










Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


0.97 


1 


0.97 


0.03 


Answer Sheet (AS) 


3171*80 


1 


3171.80 


94.91** 


Ability Level (AL) 


2342.37 


3 


780.78 


23.36** 


P x AS 


41.65 


1 


41.65 


1.25 


P x AL 


184.94 


3 


61.65 


1.84 


AS x AL 


870.43 


3 


290.14 


8.68** 


P x AS x AL 


230.29 


3 


76.76 


2.30 


Error 


21722.24 


650 


33.42 




Total 


28564.69 


665 






Tool Matching 










Source of variation 


SS 


DF 


MS 


F 


Practice (P) 


51.42 


1 


51.42 


" 7.07** 


Answer Sheet (AS) 


18.14 


1 


18.14 


2.49 


Ability Level (AL) 


64.33 


3 


21.44 


2.95* 


P x AS 


0.29 


1 


0.29 


0.04 


P x AL 


64.06 


3 


21.35 


2.94* 


AS x AL 


8.71 


3 


2.90 


0.40 


P x AS x AL 


22.22 


3 


7.41 


1.02 


Error 


4728.38 


650 


7.27 




Total 


4957.55 


665 







* Probability of rejecting null hypothesis £ .05 • 
** -Probability of rejecting null hypothesis ^ .01 
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Table 9 

Correlation fiatrlces of GATB test right and wrong scores 

* . t 

for each subject group* 





. 










Mentally Retarded Persons (N*68) 


< 






Variable 


12 3 4 


5 


6 


7 



1. Name Comparison (R) 



2. 


Computation (R) 


.55 












3. 


Vocabulary (R) 


.43 


.32 










4. 


Tool Matching (R) 


.52 


.43 


.30 








5. 


Name Comparison (II) 


.03 


.06 


-.26 


-.07 






6. 


Computation (W) 


-.07 


-.48 


-.13 


-.09 


.20 




7. 


Vocabulary (TJ) 


.32 


.24 


-.01 


.16 


.33 


.30 


8. 


Tool Matching (W) 


-.18 


-.11 


-.23 


-.40 


.54 


.19 



High School Students (N*137) 





Variable 


1 


2 


3 


4 


5 


6 


7 


1 . 


Name Comparison (R) 
















2. 


Computation (R) 


.37 














3. 


Vocabulary (R) 


.37 


.45 




- 








4. 


Tool Matching (R) 


.57 


.15 


.17 










5. 


Name Comparison (W) 


-.07 


-.29 


-.06 


.13 








6. 


Computation (V) 


.03 


-.52 


-.06 


.13 


.34 






7. 


Vocabulary (W) 


.26 


-.17 


-.29 


.24 


.13 


.37 




8. 


Tool Matching (1*7) 


.06 


-.05 


.04 


-.22 


.13 


.16 


.05 




28 



23 



A 



Table 9 (Continued) 

Correlation natrices of GATB test right and wrong scores 



for each Subject group* 



General College Students (N*77) 




Variable 


1 


2 


3 


4 


5 


6 


7 


1. 


Name Comparison (R) 
















2. 


Computation (F.) 


.54 














3. 


Vocabulary (R) 


;36 


.29 












4. 


Tool Hatching (R) 


.56 


.23 


.10 










5. 


Name Comparison (W) 


.10 


-.20 


-.10 


-.02 








6. 


Computation (T\ T ) 


.01 


-.33 


-.01 


.21 


.29 






7. 


Vocabulary (W) 


.57 


.25 


.04 


.38 


.11 


.13 




8. 


Tool Hatching (U) 


.01 


-.17 


-.07 


.06 


.42 


.44 


.06 




College of Liberal Arts 


Students 


l 

U 

00 










Variable 


1 


2 


3 


4 


5 


6 


7 


1. 


Name Comparison (R) 
















2. 


Computation (R) 


.50 














3. 


Vocabulary (R) 


.41 


.28 












4. 


Tool Hatching (R) 


.55 


.32 


.20 










5. 


Name Comparison (W) 


.05 


-.08 


-.13 


.09 








6. 


Computation (W) 


.09 


-.37 


-.09 


.07 


.25 






7. 


Vocabulary (W) 


.30 


.23 


-.13 


.30 


.24 


.22 




8. 


Tool Matching (W) 


.09 


— .06 


-.13 


.01 


.35 


.18 


.21 



* Correlations of right and wrong scores within tests are underlined. 
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to that of other groups. If this conclusion is verified , it would support 
the usefulness of a multi-variate approach to the assessment of the vocational 
abilities of mentally retarded individuals. It would likewise argue against 
continued reliance on IQ (or other forms of "total" score) in the vocational 
assessment of these individuals. 

Finally, it is worth noting again that wrong scores yield new information 
as shown by the low inter cor relations with right scores in Table 9. This is 
t true for the MR group as for the other groups. If reliable, the wrong score 

; might prove to be a useful measure of "ability". 

f 

t 

\ 

1 

j 

» 

* 

GATB Study 2 

Group vs Individual and speeded vs n on-speeded administration , 

j 

| and ability test performance 



This study was planned to examine the performance of mentally retarded 
persons under conditions of group versus individual test administration, 
and speeded versus non-speeded test administration. It was hypothesised 
that individual administration of test instructions with individual review 
of test problems would Improve the performance of mentally retarded persons. 

It was further hypothesised that administration of tests under non-speeded 
(no time limit) conditions, as opposed to speeded (with time limit) conditions, 
would Improve the performance of mentally retarded persons • 
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Method 



Subjects — Three different groups of subjects, representing three levels 
of ability, were involved in the present study: 1) a group of 59 mentally 

retarded (MR) persons from two sheltered workshops in Minnesota; 2) a group 

t 

of 121 high school (HS) students from two Minneapolis high schools; and 
3) a group of 106 College of Liberal Arts (CLA) students at the University 
of Minnesota. 

Instruments — Two GATB B-1002B tests were used: Computation and 

Vocabulary. Items from these tests were administered in their standard 
order. Subjects in ail experimental conditions were required to answer 
items on separate IBM answer sheets. The standard number of practice 
problems was used in all experimental conditions. Test administrators 

followed standard procedures except in the r.on-speeded conditions, where 
appropriate changes were made. 

Experimental design— ‘Subjects from each of the three groups were assigned 
at random to one of four experimental conditions: (a) individual administration 

with a six-minute time limit; (b) individual administration with no time limit; 
(c) group administration with a six-minute time limit; and (d) group 
administration with no time limit. Once assigned to a given condition, a 
subject received both GATB. subtests under the same condition. 

Analysis — Since different experimental conditions employed different 
time limits, the total number of correct or incorrect answers (right or 
wrong scores) would be inappropriate measures of performance. That is, 
direct comparisons between speeded and non-speeded test administration 
could not be made using these scores. Instead, the percentage of items 
answered correctly out of those attempted was taken as the dependent 
variable for the present study. A further problem arose with regard to this 
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particular dependent variable. Since GATS items are presented in an 
ascending order of idfficulty, having time to answer more difficult items 
toward the end of the tests would tend to lower one T s percentage of items 
answered correctly. Consequently, in addition to scoring for all items 
attempted (total item scoring), a second dependent variable was constructed 
by scoring only the first twenty items of each test (reduced item scoring) • 

The two independent variables, mode of administration (individual versus 
group) and time limit (six minute time limit versus no time limit) constituted 
fixed, completely crossed factors for analysis. Two-way analyses of variance 
were run for each subject group. In addition three-way analyses of variance 
were run using ability level (subject group) as a classification (blocking) 
variable, principally to observe any interactions among the independent 
variables. (These latter analyses were not entirely legitimate since it 
was impossible to assign subjects at random to ability levels.) 

Results 



Table 10 shows the means and standard deviations for total item scoring 
(percentage correct of all items attempted), for the three groups of subjects. 
The table shows a progression in mean scores, for both GATB subtests, with 
the HR group being the most variable and the CLA group the least variable. 

In almost every instance, mean scores were higher under the speeded condition 
than under the non-speeded condition. 

Table 11 shows the means and standard deviations for reduced item scoring 
(percentage correct of the first 20 items attempted). The same observations 
about progression in means and standard deviations can be made for reduced 
item scoring as were made for total item scoring. However, it is only for the 
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Table 10 



Means and standard deviations for percentage 
correct of all items attempted (total item 
scoring), by experimental condition 



■ 




Individual 






Group 




Soeeded 


Non • 


- Speeded 


Speeded 


Non • 


- Speeded 


Test 


x SD 


X 


SD . 


X 


SD 


X 


SD 


MR Group 


(N-15) 




(N*14) 




(N«=15) 




(N*15) 


Computation 


71. A 22. A4 


54.5 


29.04 


58.9 


35.62 


59.3 


28.47 


Vocabulary 


53.1 23.72 


32.1 


23.68 


54.6 


31.05 


30.5 


12.90 


HS Group 


(N-18) 




(N*17) 




(N*43) 




(N-43) 


Computation 


85.5 11.92 


80.3 


14.47 


54.0 


14.31 


84.2 


10.66 


Vocabulary 


64. 4 14.07 


41.1 


14.62 


58.5 


17.75 


43.2 


8.62 


CHA Group 


(N*25) 




(N*23) 




(N-32) 




(N*26) 


Computation 


94.4 6.00 


92.7 


8.00 


96.4 


4.46 


94.3 


5.50 


Vocabulary 


80.8 11.04 


70.2 


12.34 


150.4 


11.07 


67.0 


9.69 
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Table 11 

Keans and standard deviations for percentage 
correct of the first 20 items attempted 
(reduced item scoring), by experimental condition 



Individual Group 





Speeded 


Non - Speeded 


Speeded 


Non - Speeded 


Test 


X 


SD 


X 


SD 


x SD 


x SD 


MP Group 


(H=15) 


(N=14) 


(N*15) 


(N*15) 


Computation 


73.9 


22.21 


59.6 


29.32 


69.1 35.58 


62.2 32.72 


Vocabulary 


55.0 


24.96 


47.6 


28.85 


57.4 31.11 


42.4 22.51 


HS Group 


(N=18) 


(N-17) 


(N=*43) 


(N»A3) 


Computation 


88.0 


9.69 


84 » 7 


14.84 


85.6 14.48 


90.2 9.69 


Vocabulary 


70.7 


13.16 


65.9 


21.40 


65.5 18.64 


67.6 14. 2C 


CLA Group 


(N»25) 


(N=23) 


(N*32) 


(N*26) 


Computation 


96.0 


5.14 


96.1 


6.90 


98,0 4.90 


98.3 2.43 


Vocabulary 


91.8 


7.88 


93.3 


8.61 


90.5 9.05 


91.7 7.84 
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HR groups that we find the mean scores higher under the speeded condition 
than under the non-speaded condition. The reverse (higher under the non- 
speeded condition) was true for the CLA group and for the HS subjects under 
group administration conditions. 

Tables 12 and 13 summarize the results of the two-way analyses of 
variance for the MR group. Only one significant finding was observed: a 
significant effect for the time limit factor on the Vocabulary test, with 
total item scoring as the dependent variable. Referring back to Table 10, 
one finds that, contrary to expectations, Vocabulary scores for the MR group 
are higher under the speeded condition. Renee, one must conclude that there 
is little to be gained by Individual test administration and removal of 
time limits on the performance of mentally retarded Individuals on the 
6ATB Computation and Vocabulary tests. 

Tables 14 and 15 summarize the three-way analyses of variance. These results 
show, unsurprisingly, that ability level is the most important factor of 
the three (ability level, time limit, and mode of administration) in 
performance on the GATB Computation and Vocabulary tests for both total item 
scoring and reduced item scoring. Use of time limits was a significant 
factor when total item scoring was the dependent variable. The looked- 
for Interactions among the three independent variables failed to materialize. 
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Table 12 

Two-way analyses of variance for total item scorinp, 
for the mentally retarded group 



Computation 



Source of variance 


SS 


DF 


MS 


F 


Node of Administration 


19.49 


1 


19.49 


0.02 


Time Limit 


2600.27 


1 


-260G.27 


3.02 


Mode x Time 


192.76 


1 


192.76 


.22 


Error 


47132.97 


55 


856.93 




Total 


49945.49 


58 






Vocabulary 










Source of variance 


SS. 


OF 


IIS 


F 


Mode of Administration 


.09 


1 


.09 


0.00 


Time Limit 


7503.22 


1 


7503.22 


13.32** 


Mode x Tine 


36.28 


1 


3C.2S 


0.06 


Error 


30991.20 


55 


563.48 




Total 


38530.79 


58 







** Probability of rejecting null hypothesis ~ .01 
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Table 13 

Two-way analyses of variance for reduced item scoring, 
for the mentally retarded group 



Computation 



Source of variance 


SS 


DF 


MS 


F 


llode of Administration 


18.53 


1 


18.53 


0.02 


Time Limit 


1659.55 


1 


1659.55 


1.80 


Hode x Time 


199.42 


1 


199.42 


0.22 


Error 


50794.28 


55 


923.53 




Total 


52671.78 


58 






Vocabulary 










Source of variance 


SS 


DF 


MS 


F 


Mode of Administration 


29.78 


1 


29.78 


0.04 


Time Limit 


1841.52 


1 


1841.52 


2.52 


Mode x Time 


215.21 


1 


215.21 


0.29 


Error 


40180.41 


55 


730.55 




Total 


42266.92 


58 








37 



Table 14 



Three-way analyses of variance for total item scoring 



Computation 



Source of variance 


SS 


DF 


MS 


F 


Mode of Administration 


118.96 


1 


118.96 


0.47 


Time Limit 


2137.68 


1 


2137.68 


8.38** 


Ability Level 


36001.34 


2 


18000.34 


70.54** 


Mode x Time 


259.61 


1 


259.61 


1.02 


Mode x Ability 


6.26 


2 


3.13 


0.01 


Time x Ability 


1409.82 


2 


704.91 


2.76 


Mode x Time x Ability 


169.35 


2 


84.67 


0.33 


Error 


69916.37 


275 


255.17 




Total 


110019.39 


285 






Vocabulary 










Source of variance 


SS 


DF 


MS 


F 


Mode of Administration 


51.04 


1 


51.04 


0.21 


Time Limit 


19103.45 


1 


19103.45 


78.66** 


Ability Level 


47196.24 


2 


23598.12 


97.17** 


Mode x Time 


.08 


1 


.08 


0.00 


Mode x Ability 


30.43 


2 


15.21 


0.06 


Time x Ability 


1147.86 


2 


573.93 


2.36 


Mode x Time x Ability 


304.07 


2 


152.03 


0.63 


Error 


66542.90 


274 


242.86 




Total 


134376.07 


285 







** Probability of rejecting null hypothesis ib .01 
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Table 15 

Three-way analyses of variance for reduced item scoring 



Computation 



Source of variance 


SS 


DF 


MS 


F 


Mode of Administration 


43.26 


1 


43.26 


0.17 


Time Limit 


643.86 


1 


643.86 


2.48 


Ability Level 


35933.61 


2 


17866.81 


69.11** 


Mode x Time 


410.28 


1 


410.28 


1.58 


Mode x Ability 


103.19 


2 


51.60 


0.20 


Time x Ability 


1400.76 


2 


700.38 


2.69 


Mode x Time x Ability 


226.14 


2 


113.07 


0.43 


Error 


71234.96 


274 


259.98 




Total 


109996.06 


285 






Vocabulary 










Source of variance 


SS 


DF 


MS 


F 


Mode of Administration 


146.74 


1 


146.74 


0.50 


Time Limit 


866.19 


1 


866.19 


2.96 


Ability Level 


69601.55 


2 


34800.78 


118.93** 


Mode x Time 


1.99 


1 


1.99 


0.01 


Mode x Ability 


1.28 


2 


0.64 


0.00 


Time x Ability 


1516.28 


2 


758.14 


2.59 


Mode x Time x Ability 


496.09 


2 


248.04 


0.85 


Error 


80177.21 


274 


292.62 




Total 


152807.33 


285 







** Probability of rejecting null hypothesis jfl .01 
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GATH Study 3 



Influence of verbal loading on ability test performance 



Purpose 

The purpose of this study was to Investigate the effect of the verbal ability 
factor on the ability test performance of the mentally retarded. On the 
assumption that the mentally retarded person's test performance is weakest 
on items requiring verbal ability, it was hypothesized that by removing items 
which correlated with verbal ability from measures of other ability dimensions, 
one could increase the validity of the latter measures for use with the 
mentally retarded. 

Method 

Subjects — The subjects of this study were 667 Minnesota Division of 
Vocational Rehabilitation (DVR) clients, a sample of 53 mentally retarded 
DVR clients, and a second group of 60 non-retarded DVR clients. 

Instruments — Six tests of GATB Form B-1002B were used: Name Comparison, 

Computation, Three-Dimensional Space, Tool Matching, Arithmetic Reasoning, 
and Form Matching. The performance tests were not included since these were 
not constructed from separate items. The Vocabulary test was used as the 
measure of Verbal Ability. All tests were administered in the standard manner. 

Analysis — Since the verbal ability loading of test items can be estimated 
from their correlation with a verbal (e.g., vocabulary) measure, the first 
objective of the analysis was to eliminate from the six GATB tests those 
items that correlated with the Vocabulary test. The GATB performance of 667 
DVR clients was examined for this purpose, and the correlation of scores on 
each of the items on the six GATB tests with total score on the Vocabulary 
test was computed. All items which correlated significantly (for N’s^ 20 
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persons) were classified according to three levels of correlation: 1) .25; 
2) > .20; and 3) j? .15. These items constituted the ’’’verbally loaded” items 
(the higher the correlational level, the more verbally loaded). After 
progressively eliminating "verbally loaded" items, GATB test scores were 
recomputed for a sample of 53 retarded DVR clients and a sample of 60 non- 
retarded DVR clients (separate scores for each of the three levels of verbal 
loading). The degree of overlap between these two groups (retarded vs. non- 
retarded), using the Tilton overlap statistic, was computed at each level of 
verbal loading. 

Results 

Table 16 shows the percent of overlap between the retarded and non-retarded 
groups for the different levels of verbal loading. It can be seen that the 
overlap between the groups increased after elimination of items for the 
Three-Dimensional Space and Arithmetic Reasoning tests. However, for the 
remaining four GATB >ttsts the overlap between the groups did not increase 
as the items which correlated significantly with the Vocabulary test were 
progressively eliminated. Table 17 details the number of items removed at 
each level of elimination. 



These data suggest that the elimination of items correlating with verbal 
ability in the Three-Dimensional Space and Arithmetic Reasoning tests of 
the GATB can lead to more accurate measurement of these two vocational 
abilities for the mentally retarded. For the four other GATB tests studied 
(Name Comparison, Computation, Tool Matching and Form Matching), the 
elimination of such items failed to produce the desired effect. 
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Table 17 



Humber of items eliminated, by level 



GATB Test 


rJT .25 


r > .20 


ri .15 


Total 


1. Name Comparison 


4 


8 


7 


19 


2 . Computation 


1 


3 


9 


13 


3 . Three-Dimens ional 
Space 


8 


13 


6 


27 


4. Tool Hatching 


4 


3 


9 


16 


5. Arithmetic 
Reasoning 


4 


4 


9 


17 


6. Form Matching 


1 


1 


6 


8 
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GATB Study 4 

Difficulty of instruction and practice, and ability test performance 



Purpose 

This study was designed to investigate the effects of the difficulty of test 
instructions and the difficulty of practice problems on ability test 
performance. It was hypothesized that by simplifying instructions and 
practice problems, mentally retarded individuals would perform better in ability 
tests. 

Method 

Subjects — The subjects of the study were 167 mentally retarded individuals 
from seven Minnesota sheltered workshops. (See Introduction for a more 
detailed description of this group.) 

Instruments — Four GATB B-1002B tests were used in the present study: 

Name Comparison, Computation, Vocabulary, and Tool Matching. The tests 
were administered under standard time limits and with the items in their 
usual order. Separate answer sheets were not used in any of the experimental 
conditions. Examinees were required to answer the items on the test booklets 
themselves . 

Twice as many practice problems as found in the standard GATB tests were 
used in all of the experimental conditions. There were 12 practice problems 
for Name Comparison, 4 for Computation, 6 for Vocabulary and 4 for Tool 
Matching. For each test, two instructional problems (from the standard 
GATB) were used in demonstrating the test task prior to practice on the 
practice problems. 



■ 
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Experimental desii^n— -The study took the form of a 2 x 2 factorial 
experiment. Each subject was assigned at random to one of four experimental 
conditions; (a) Standard difficulty instructions and standard difficulty 
practice; (b) Standard difficulty instructions and simplified practice; 

(c) Simplified instructions and standard difficulty practice? (d) Simplified 
Instructions and simplified practice. Once assigned to a given experimental 
condition, a sublect received all four tests under that experimental condition. 

''Standard difficulty instructions* 1 were standard GATB instructions modified 
for a no-separate-answer-sheet administration. 'Simplified instructions" 
involved the elimination of all written directions, the simplification of 
oral directions, and the use of group demonstration cards for the practice 
items. For ‘standard difficulty practice" condition, GATB instructional and 
practice problems were kept in their original order, and practice problems 
of similar difficulty were added to the standard practice problems. 

Simplified practice' involved the addition of simplified and less difficult 
problems and the rearrangement of instructional and practice problems so that 
easier problems came first. 

Analysis — Two dependent variables were used j right scores and wrong 
scores. An individual’s right score for a given subtest was the total number 
of items he answered correctly. An individual's wrong score for a given 
test was the total number of items he answered incorrectly. 

The two independent variables, difficulty of instructions and difficulty of 
practice, constituted fixed, completely crossed factors for analysis. Two- 
way analyses of variance were run for both right and wrong scores. 
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Results 

Fight score means and standard deviations for each experimental condition 
are shown in Table 18. Wrong score means and standard deviations are given 
in Table 19. Results of the two-way analyses of variance for right and wrong 
scores are summarized in Tables 20 and 21 respectively. As these tables 
show, the only significant finding was the difference in wrong-score means 
for the Computation test found between those taking the test under simplified 
instructions and those taking the test under standard instructions. The 
direction of the difference was opposite to that expected, with poorer 

i. 

performance on the part of subjects under the simplified instructions 
condition (they obtained higher wrong scores) . It can only be concluded, 
therefore, that simplifying instructions and practice problems was not shown 
to be helpful in improving the ability test performance of mentally retarded 
individuals . 



I 




Table 22 shows the intercorrelations among right and wrong scores for the 
four GATB tests. (See GATB Study 1 for similar data-) Subjects in all four 
treatments combined were used in calculating these correlations. Inter correlations 
between right scores were generally high, ranging from .55 to .75. Wrong 
score intercorrelations were lower, ranging from .20 to .50. Correlations 
between right and wrong scores within tests ranged from -.16 to .27, 
demonstrating the relative independence of the two dependent variables 
Included in the study. It can be concluded that added information about the 
abilities of mentally retarded persons could be gained through the use of 
’wrong” scores (scoring wrong responses) . 
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Table 18 



Right score means and standard deviations 
by treatment combination 



Standard difficulty 

instructions Simplified instructions 

Standard difficulty Simplified Standard difficulty Simplified 
GATE Test practice practice practice practice 

x SD x SD x SD x BD 



Name Comparison 


28.3 


17.01 


28.6 


15.33 


25.4 


14.85 


26.4 


14.57 


Computation 


9.5 


7.83 


9.8 


7.30 


8.2 


6.22 


10.4 


6.85 


Vocabulary 


7.3 


5.69 


8.0 


6.86 


6.2 


6.34 


7.1 


6.48 


Tool Matching 


19.6 


9.05 


18.2 


8.39 


16.9 


9.43 


9.0 


9.91 



Table 19 

Frong score means and standard deviations 
by treatment combination 



GATB Test 


Standard difficulty 
instructions 




Simplified instructions 


Standard difficulty 
practice 


Simplified 

practice 


Standard difficulty 
practice 


Simplified 

practice 


x SD 


X 


SD 


X 


SD 


x SD 




(N-47) 


(11=37) 


(N= 


=44) 


(N=39) 


Name Comparison 


5.9 4.96 


6.6 


6.52 


7.0 


5.32 


6.4 5.95 


Computation 


2.6 2.20 


3.8 


4.11- 


6.2 


5.65 


5.8 7.27 


Vocabulary 


9.7 8.42 


8.9 


10.44 


7.7 


7.15 


10.0 9.58 


Tool Thatching 


3.4 4.20 


3.2 


4.19 


5.2 


6.87 


3.7 3.72 
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Table 20 



Two-way analyses of variance: 
Right scores as the dependent variable 



Name Comparison 



Source of variation 


SS 


DF 


MS 


F 


Instructions 


271.78 


1 


271.78 


1.13 


Practice 


17.46 


1 


17.46 


.07 


Instr x Pract 


4.39 


1 


4.39 


.02 


Error 


39336.40 


163 


241.33 




Total 


39630.03 


166 






Computation 










Source of variation 


SS 


DF 


MS ' 


F 


Instructions 


4.14 


1 


4;i4 


.08 


Practice 


58.63 


1 


59.63 


1.17 


Instr x- Pract 


36.89 


1 


36.89 


.73 


Error 


8192.04 


163 


50.26 




Total 


8291.70 


166 






Vocabulary 










Source of VAT* Ant ion 


SS 


DF 


MS 


F 


Instructions 


44.16 


1 


44.16 


1.11 


Practice 


27.29 


1 


27.29 


• 68 


Instr x Pract 


.28 


1 


.28 


.01 


Error 


6512.12 


163 


39.95 




Total 


6583.85 


166 






Tool Matching 










Source of variation 


SS 


DF 


MS 


F 


Instructions 


40.25 


1 


40.25 


,47 


Practice 


4.88 


1 


4.88 


• 06 


Instr x Pract 


125.91 


1 


125.91 


1.48 


Error 


13862.78 


163 


85*05 




Total 


14033.82 


166 
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Table 21 

Two-way analyses of variance: 
Wrong scores as the dependent variable 



Name Comparison 



o 

ERIC 



Source 0 f variation— 


SS 


DF 




F 


Instructions 


8.29 


1 


8.29 


0.26 


Practice 


0.20 


1 


0.20 


0.01 


Instr X Pract 


17.96 


1 


17.96 


0.56 


Error 


5224.61 


163 


32.05 




Total 


5251.06 


166 






Computation 










Source of variation 


SS 


. m 


MS 


F 


Instructions 


327.21 


l 


327.21 


12.66** 


Practice 


6.34 


l 


6.34 


0.25 


Instr x Pract 


24.88 


l 


24.88 


0.96 


Error 


4212.28 


163 


25.84 




Total 


4570.71 


166 






Vocabulary 










Source of variation 


SS 


DF 


ns 


F 


Instructions 


9.01 


1 


9.01 


0.11 


Practice 


22.86 


1 


22.86 


0.29 


Instr x Pract 


102.62 


1 


102.62 


1.30 


Error 


12870.52 


163 


78.96 




Total 


13005.01 


166 






Tool Matching 










Source of variation 


SS 


DF 


MS 


F 


Instructions 


53.87 


1 


53.87 


2.20 


Practice 


31.94 


1 


31.94 


1.30 


Instr 3 1 Pract 


16.76 


1 


16.76 


0.68 


Error 


3999.56 


163 


24.54 




Total 


4102.13 


166 







** Probability of rejecting null hypothesis jr .01 
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Table 22 

Correlation matrix of GATB test right and 
wrong scores® (N*167) 





1 


2 


3 


4 


5 


6 


7 


1. Name Comparison (P.) 

2. Computation (R) 


.76 














3. Vocabulary (R) 


.71 


.69 












4. Tool Hatching (R) 


.72 


.62 


.55 










5. Name Comparison (U) 


-.01 


-.16 


-.24 


-.01 








6. Computation (W) 


-.09 


-.16 


-.15 


.03 


.46 






7 . Vocabulary <T*7) 


.41 


.31 


.27 


.39 


.20 


.27 




8. Tool Matching (W) 


-.13 


-.19 


-.21 


-.10 


.35 


.50 


.21 



a Correlations of right and wrong scores within subtests are underlined. 



o 
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Item development 



Purpose 

The purpose of this study v/as to begin construction of a pair comparisons form 
of the Minnesota Importance Questionnaire UflQ) for use with mentally retarded 
individuals. Specifically, the study was directed toward developing an item 
pool from the original IIIQ items which would: 1) be understandable to adult 

mentally retarded individuals: and 2) yield results equivalent to those of 
the standard form of the MIQ when applied to a non-retarded group. 

Method 



Subjects — Thirty-six mentally retarded individuals employed in a sheltered 
workshop constituted one sample of subjects in this study. A second subject 
sample (for comparison purposes) consisted of 29 clients of the State Division 
of Vocational Rehabilitation who were considered 'normal'’ (i.e., non-retarded) 
and who were sent to the Work Adjustment Project for vocational assessment. 

Procedure — The standard form of the MIQ consists of the 20 statements in 
a pair comparison format. Each statement represents one need dimension. Table 
23 list 8 the 20 vocational need dimensions measured by the MIQ, each 

dimension's representative statement on the regular MIQ form, and a corresponding 

f 

simplified statement revised for use with the mentally retarded. These 
revised statements were judged by a graduate seminar in psychology to be 
equivalent in meaning to thn regular MIC statements, buc to require lower 
verbal ability to understand them. 



miq scales: Regular and revised stateTnents 
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The mentally retarded (MR) sample was divided into 3 groups of 12 persons each. 
Each group was administered a different subset of the revised statements. This 
reduced the number of pair comparisons to be administered, the most being 
21 pairs (for 7 statements). The first group was given Form I, which consisted 
of the following 7 dimensions: Company Policies and Practices, Ability 

Utilization, Responsibility, Co-workers, Social Service, Supervisor-Human 
Relations, and Activity. Form II was given to the second group. It 
consisted of the following 6 dimensions: Supervision-Technical, Security, 

Achievement,^ Moral Values, Creativity, and Authority. Form III was administered 
to the third group. This form consisted of the following 7 dimensions: 
Recognition, Working Conditions, Variety, Advancement, Independence, Social 
Status, and Compensation. All administrations were done verbally. 



The "normal" sample (the DVR clients) was similarly divided into three groups 
and the three forms mentioned above administered to them, a different form 
to each group. In addition, the "normal" subjects had previously completed 
the regular MIQ form as part of their vocational assessment. 



Results 




Tables 24 through 26 present statistics summarizing the scores for both 
mentally retarded (HR) and "normal" (N) samples. The tables also present 
data on circular triads, logically Inconsistent responses in which A is 
preferred to B, B to C, and C to A. Significant differences in mean circular 
triad score were obtained between MR and N groups for all three administrations. 
It is apparent from these data that the MR subjects were more logically 
inconsistent than the "normal" subjects. The probability of random responding 
was determined from the data on circular triads. Based on this determination, 
eight of the HR subjects, compared with three of the "normal" subjects, were 
judged as having responded randomly. Twenty-two MR and the remaining 26 



Table 24 



Means and variances for Form I 
scales, by group (liR vs K) 



1. Ability Utilization 

2 . Activity 

3 * Company Policies 
and Practices 

4 . Co-l!orkers 

5 . Responsibility 

6 . Social Service 

7. Supervision - Human 

Relations 

Circular triad score 



Kean 

I!R(N*12) N(N*9) t 



2.17 


4. 00 


3.73** 


3.08 


2.00 


2.30* 


2.92 


3.17 


0.35 


3.58 


2.50 


2.98** 


2.42 


3.42 


1.82 


3.58 


2.58 


1.35 


3.25 


3.50 


0.44 


7.75 


4.56 


2.07* 



Variance 



13 ? .(N as 12) 


N(H*9) 


F 


1.42 


1.46 


1.03 


0.99 


1.64 


1.66 


2.45 


3.80 


1.55 


0.99 


2.27 


2.29 


2.27 


1.37 


1.66 


2.08 


4.27 


2.05 


1.84 


2.10 


1.14 


11.67 


13.03 


1.12 



* Probability of rejecting null hypothesis ~ .05 

** Probability of rejecting null hypothesis ~ .01 
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Table 25 

Keans and variances for Form II 
scales, by group (!$. vs E) 



Var iance 



Scales 


KR(N«12) N(N*9) 


t 


1<R(K»12) N(N**9) 


F 


1 . Achievement 


3.67 


4.00 


2.41* 


1.15 


1.00 


1.15 


2 . Authority 


1.92 


1.36 


2.21* 


4.08 


3.25 


1.26 


3 . Creativity 


1.75 


2.46 


3.97** 


2.02 


1.66 


1.22 


4 . IToral Values 


1.42 


1.54 


.76 


.99 


1.88 


1.90 


5. Security 


3.42 


1.83 


1.57 


.99 


11.30 


11.41** 


6 . Supervisions 
Technical 


2.83 


1.33 


7.98** 


1.06 


3.10 


2.92 


Circular triad score 


1.83 


.55 


5.82** 


4.70 


.67 


7.01* 



/ 

r ~ , 1- , - ■— -- - - - ; - -- ----- , - 

/ 

* Probability of rejecting null hypothesis £ .05 
**Probability of rejecting null hypothesis f; .01 
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Table 26 

Means and variances for Porn III 
scales, by group (MR vs IT) 



Mean Variance 

Scales HR(N«12) t?(I!=9) t 1!R(N=12) N(N«9) F 

i 



1 . 


Advancement 


3.33 


4.90 


8.53** 


2.22 


.99 


2.24 


2. 


Compensation 


2.83 


3.00 


.67 


2.13 


4.45 


2.09 


3. 


Independence 


2.50 


2.40 


.43 


3.53 


1>62 


2.18 


4. 


Recognition 


3.75 


4.20 


2.01 


2.19 


2.86 


1.31 


5. 


Social Status 


2.92 


.20 


21.08** 


1.35 


.18 


7.50** 


6. 


Variety 


3.08 


2.60 


1.67 


7. A0 


.94 


7.87** 


7. 


Working Conditions 


2.58 


3.70 


5.66** 


1.54 


2.46 


1.60 


Circular triad score 


6.17 


1.11 


4.64** 


8.15 


3.10 


2.63 



* Probability of rejecting null hypothesis —.05 
** Probability of rejecting null hypothesis .01 
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"normal" subjects did not respond randomly. The data were Inconclusive for 
6 MR subjects. Thus, there is evidence that MR subjects could respond mean- 
ingfully to the revised MIQ statements. 

Significant differences in mean scores between the MR and "normal" samples 
were obtained on 10 of the 20 scales. Significant differences in variances 
were observed for four scales. These findings indicate that MR subjects 
responded somewhat differently to the revised MIQ items than did the "normal" 
comparison group subjects, but also that individual differences in response 
are to be found among MR subjects as among 'normals". 

Tables 27 through 29 compare the responses of the "normal" subjects to the 
revised MIO statements with their responses to the regular MIQ statements. 

, t 

Scores for the regular MIQ statements were reconstructed from their 
responses to the regular MIQ in such a way as to parallel the three forms 
using the revised statements. (For example, if a subject completed Form I 
with the revised statements, his completed regular MIO was scored for only 
the Form I scales, i.e., the seven scales listed in Table 27). As Tables 
do show, similarity between the results for the two forms (revised vs. 
regular) provide some evidence for the equivalence of the two forms. 

This study provided encouragement for the attempt to develop an KIQ form 
for use with mentally retarded individuals* To be useful, such a form, in 
addition to meeting the usual psychometric requirements, should exhibit 
properties of being understandable to MR subjects and at the same time being 
equivalent to the regular form of the MIQ. The next studies concentrated 
on the twin problems of understandability and equivalence. 



Table 27 



Means and standard deviations of Form I 
MIQ scales for a sample of DVR 
clients (N g 9), by type of statement 













Scale 


Mean 




£ 




_ a 

Reg 


Rev* 5 


Reg 


Rev 


1. Ability Utilization 


4.8 


4.0 


1.30 


1.21 


2. Activity 


1.9 


1.9 


1.45 


1.28 


3. Company Policies 
and Practices 


2.9 


3.2 


1.61 


1.95 


4. Co-Workers 


2.2 


2.0 


1.30 


1.70 


5. Responsibility 


2.9 


3.4 


1.17 


1.17 


6. Social Service 


3.7 


2.6 


1.94 


2.07 


7. Supervision-Human 
Relations 


2.7 


3.5 


2.06 


1.45 


Circular triad score 


3.9 


3.6 


4.56 


4.58 



a 

Regular MIQ Statements 
Revised MTQ statements 



Table 28 



Means and standard deviations of form H 
MIQ scales for a sample of DVR 
clients (N=9)> by type of statement 



- ‘.vr. 


Scale 


Mean 


b 


SD 






J?ega 


Rev 


Reg 


Rev 


1. Achievement 


3.5 


4.0 


1.44 


1.00 


2. Authority 


1.1 


1.4 


1.22 


1.80 


3. Creativity 


3.4 


2.5 


1.29 


1.29 


4. Moral Values * 


1.7 


1.5 


1.42 


1.37 


5. Security 


2.9 


1.8 


1.45 


3.36 


6. Supervision- 










Technical 


2.4 


1.3 


1.03. 


1.76 


Circular triad score 


1.7 


.5 


1.60 


.78 



a 

^Regular MIQ Statements 
Revised MIQ Statements 
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Table 29 



Means and standard deviations of Form III 
MIQ scales for a sample of DVR 
clients (N~9) * by type of statement 





Scale 


Mean 


B&P 


SD 






Reg a 


Reg 


Rev 


1. Advancement 


5.3 


4.9 


1.32 


.99 


2. Compensation 


2.7 


3.0 


1.12 


2.11 . 


3. Independence 


2.3 


2.4 


1.73 


1.27 


4. Recognition 


3.3 


4.2 


1.32 


1.69 


5. Social Status 


1.3 


.2 


1.32 


.42 


6. Variety 


2.1 


2.6 


1.45 


.97 


7. Working Conditions 


3.9 


3.7 


1.62 


1.57 


Circular triad score 


2.4 


1.1 


2.55 


1.76 



a 

b Regular MIQ Statements 
Revised MIQ Statements 
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KIQ Study 2 

Estimation of item understandability 



Purpose 

This study was designed to estimate the understandability (for mentally 
retarded individuals) of various versions of the MIQ items. Understandability 
of the items was to be judged by experienced teachers, counselors, and 
other persons working with the mentally retarded. 

Method 

Instrument — An instrument was developed consisting of 55 items 
representing the 20 scales of the HIQ. Each of the original 20 MIQ items 
was presented in three different forms. The first item form was the 
original version of the MIQ item. The second item form was the product of 
a graduate seminar in psychology (see MIQ Study 1). The third item form 
was devised by one of the research assistants working on this study. It 
was not always possible to generate three item forms for comparison. Those 
scales which had only two item forms were? Activity, Advancement, Authority, 
Compensation, Independence, P.ecognition, and Security. Two items were 
repeated in the instrument to obtain some idea of how carefully the respondents 
were answering. These two items were presumed to represent extremes of 
understandability to the mentally retarded. 

The instrument called for the respondent to rate the various MIQ item forms 
in terms of whether it would be understood by the group of mentally retarded 
persons he/she currently worked with. Each item form was rated on the following 
scale: N*not understood by any; S-understood by some; I!»understood by most; 

and A*understood by all. For scale values, N was weighted 1, S was weighted 



B3 



58 



Subjects — The Instrument was sgnt to 19 professional staff members 
from two organizations in Minneapolis concerned with the retarded. Twelve 
of these Individuals were employed by the Cooperative School Rehabilitation 
Center (CSRC) and seven were employed by Opportunity Workshop (OWS) . 

Procedure- Copies of the instrument were sent to the two institutions 
for completion by their professional staff. CSRC returned 12 instruments 
and OWS returned 7 of them. 

Mean under standability ratings were calculated for each item form. Because 
of an obvious difference in their ratings, mean ratings were calculated 
separately for each institution's group of raters* 

Results 

Table 30 summarizes the ratings, separately for each institution group and 
for each version (original, seminar, and research assistants). It is 
clear from this table that both sets of raters rated the original item 
versions as difficult for the mentally retarded to understand. The version 
most frequently rated highest in understandabillty was the seminar version 
(16 times in 20) . OWS raters judged 18 seminar version items as being above 
2.5 (midpoint of the scale), while CSRC raters reached the same judgment for 

f 

i 

| 14 seminar version items. The corresponding numbers for the research 

j assistant's version are 9 (by OWS) and 7 (by CSRC). 

i 

> 

i 

j These data were utilized in constructing a Form N version of the MIQ, 

1 

‘ consisting of items rated above 2.50 for 18 of the 20 scales by OWS raters 

and for 15 of the 20 scales by CSRC raters. Median ratings for the Form M 

| items were 3.17, for OWS ratings, and 2.83, for CSRC ratings. Table 31 

i 

rM lists the standard (Form P) and Form M items for each of the 20 MIQ scales. 
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Table 30 

Mean understandability ratings for original 
and revised* MIQ items, by institution 



Scale 



.QWSlNffl 

S d 



RA e 



CSFC flN12) 



FA 



Ability Utili- 
zation 


2.14 


3.00 


3.00 


2.00 


2.67 


2.83 


Achievement 


1.71 


2.57 


2.29 


1.75 


2.33 


2.25 


Activity 


(a) 


3.59 


3.57 


(a) 


3.17 


3.17 


Advancement 


1.71 


2.86 


<b) 


1.75 


2.58 


(b). 


Authority 


3.43 


3.29 


(b) 


3.08 


2.83 


(b) 


Company Policies 
and Practices 


1.29 


2.86 


3.29 


1.08 


2.33 


2.33 


Condensation 


2.00 


3.14 


(b) 


1.83 


2.75 


(b) 


Co-Workers 


2.14 


3.43 


3.57 


2.25 


3.00 


3.33 


Creativity 


2.14 


3.00 


2.43 


2.17 


2.33 


2.00 


Independence 


3.43 


3.71 


(b) 


3.25 


3.17 


(b) 


Moral Values 


1.57 


2.57 


2.00 


1.08 


2.25 


2.17 


Recognition 


2.00 


3.57 


(b) 


1.58 


3.08 


Co) 


Responsibility 


2.14 


2.43 


2.17 


2.00 


2.17 


2.00 


Security 


2.14 


2.14 


(b) 


3.17 


2.08 


(b) 


Social Service 


(a) 


3.29 


3.00 


(a) 


3.25 


2.92 


Social Status 


2.14 


3.29 


3.29 


1.67 


2.92 


2.50 


Supervision-Human 

Relations 


1.86 


3.14 


3.00 


1.33 


2.83 


2.83 


Supervision- 

Technical 


2.57 


' 3.17 


3.00 


2.33 


2.92 


2.73 


Variety 


3.43 


3.14 


3.29 


2.92 


2.67 


2.83 


Working Conditions 


2.29 


3.57 


2.00 


2.08 


3.58 


2.00 



a 

. 0WS= Opportunity Workshop 
d C 3RC= Cooperative School Hehabilitation Center 
Original version 
Q S~ Seminar version 
RA= Research assistant version 

(a) = omitted; in both cases because the seminar version was identical to the 

original except for starting the item with ’’you..." instead of ”1...” 

(b) = no version written 
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Table 31 
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MIQ Study 3 

Equivalence of Fora M and Form P 



Purpose 

This study was conducted to determine whether or not the revised items of 
Form M measured the same need dimensions as those measured by the 1967 
standard form (designated as Form P). Such equivalence can be evaluated 
in several ways, e.g. , individual item equivalence, profile equivalence, etc. 
Since the main use of the MIQ in vocational rehabilitation counseling is in 
terms of profiles, profile equivalence was the focus of the present study. 

Method 

Subjects — One hundred ten subjects were drawn from the University of 
Minnesota experimental psychology pool. Most of these subjects were college 
sophomores majoring in the College of Liberal Arts. 

Procedure — Two forms of the KIO, one standard (Form P) and one revised 
(Form M) were used in this study. Form M, the revised form, was constructed 
frou item stems resulting from the preceding unders tandablllty study. An 
identical format was employed for both forms, i.e., printing style and size, 
paper size, instructions and number of items per page. 

Subjects were randomly assigned to one of three experimental groups. The 
design required each subject to complete two forms in an immediate test** 
retest paradigm. The following were the experimental groups: 



Group 


Test 


Retest 


N_ 


Group I 


Form P 


Form P 


42 


Group II 


Form P 


Form M 


34 


Group III 


Form M 


Form P 


34 
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To demonstrate equivalence, the test-retest correlations between Forms P 
and M should not differ significantly from the test-retest correlations 
between Form P and itself. Furthermore, there should be no ordering effect. 

Analysis — Profiles obtained from the test and retest forms of the M.IQ 
were correlated for each individual. The resulting individual (profile) 
correlations were pooled for each group. The distribution of profile 
correlations resulting from the Form P test-retest group (Group I) was 
used as the "control 1 ' against which to test the profile-correlation 
distributions for the other groups. 

Results 

Table 32 summarizes the data. The median profile correlation for Group 
the group which repeated the standard form (Form P), was .94. Comparison of 
the data for Groups II and III showed no significant distribution differences 
(i.e., there were no order effects.) These data were then combined, yielding 
a median profile correlation of .85. A median test of the difference between 
profile correlation distributions for Groups II and III combined and that 
for Group I was statistically significant. 



i 

i 



i 



X 

I 



Since Form M did not show equivalence with Form P at the profile level, 
equivalence at the scale level was laves tigated. The relevant data are shown 
in Table 33. Scale score differences between Form M and Form P were analyzed. 
This analysis showed that 9 of the 20 scales of Fora M yielded results which 
were significantly different from the corresponding Form P scale results. The 
eleven scales for which no significant differences were obtained were: 
Activity, Advancement, Authority, Company Policies, Compensation, Co-Workers, 
Independence, Security, Social Service, Supervision-Technical, and Variety. 
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Table 32 



Distribution of test-retest (profile) 
correlations, by group 





Correlation 

range 


Group I 
(p-p) 


Groups II & III 
(P-M & >l-p) 



.96 - 


1.00 


7 


2 


.91 - 


.95 


26 


11 


186 •“ 


.90 


5 


19 


.81 - 


.85 


2 


13 


.76 - 


.80 


1 


11 


.71 - 


.75 


1 


6 


.66 ~ 


.70 




2 


.61 - 


.65 




It 


.56 - 


.60 




1 


.51 - 


.55 




0 


.46 - 


.50 




1 






42 


68 


Median correlation 


.94 


.85 


Median for combined groups a 


.89 





a '$ for median test * 26.5 (ldf, P ^-.001) 



Table 33 



Cross-correlations for parallel scales from Forms P and w 5 

by scale 



Scale 



Forms paired 

P.p(N=i»2) pjvj(N=6tt) 



1. Ability Utilization 


.72 


.15*** 


2. Achievement 


. 88 


.52*** 


3. Activity 


.88 


.84 


4. Advancement 


.81 


.73 


5. Authority 


.87 


.91 


6. Company Policies 


.85 


.74 


7. Compensation 


.90 


.86 


8. Co-Workers 


.89 


.80 


9. Creativity 


.92 


.74** 


10. Independence 


.89 


.86 


11. Moral Values 


.90 


.77* 


12. Recognition 


.90 


.39*** 


13. Responsibility 


.86 


.68* 


14. Security . 


.80 


.89 


15. Social Service 


.89 




16. Social Status 


.93 


.57** 


17. Supervision-Human 






Relations 


.89 


.70** 


18. Supervision-Technical 


.02 


.76 


19. Variety 


.90 


.83 


20. Working Conditions 


.91 


.60*** 



♦Probability of 05 in rejecting null hypothesis*, one tailed 
testing using Fisher* s 2 transformation. 

** Probability of 01 in rejecting null hypothesis: one-tailed test. 

*** Probability of 001 in rejecting null hypothesis*, one-tailed test. 
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MIQ Study 4 

Wording revision of nine scales 



Purpose 

The purpose of this study was to revise the wording of the nine Form M 

scales found in the preceding study not to he equivalent to Form P scales. 

These nine scales were: Ability Utilization, Achievement, Creativity, Moral 

* 

Values, Recognition, Responsibility, Social Status, Supervis ion-Human Relations 
and Working Conditions. 

Method 

Subjects — Ten mentally retarded individuals in a workshop were the subject 
in this study. 

Procedure — Interviews were held individually with the ten mentally 
retarded subjects. The meanings of words and concepts used in the HIO were 
explored in these interviews. Particular attention was given to the mental 
retardates typical vocabulary. The interviews usually took two hours to 
complete. Based on information provided by these interviews, the item stems 
for the nine non-equivalent scales were reworded. 

Understandability of the reworded item stems was inferred by applying two 
formulas that measure vocabulary difficulty, the Dale-Chall and the Flesch 
formulas. These two formulas were originally developed for measuring the 
difficulty or reading level of whole paragraphs, but were used here in lieu of 
formula to assess the reading level of individual sentences. 
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Results 



Listed below are rewordings of the nine stems based on information provided 
by the interviews s 

1. Ability Utilization 

Form P: I could do something that makes use of my abilities. 

Revision: You could do the kind of work that you do best. 

2. Achievement 

Form P: The job could give me. a feeling of accomplishment. 

Revision: The job could make you feel useful. 

3. Creativity 

Form P: 1 could try out some of my own ideas. 

Revision: You could try to do things the way you think they should be done. 

4. Moral Values 

Form P: I could do the work without feeling that it was morally wrong. 

Revision: You would not feel that you were doing wrong. 

5. Recognition 

Form P: I could get recognition for the ttork Z do. 

Revision: You could get praise and credit for the work you do. 

6. Responsibility 

Form P: I could make decisions on my own. 

Revision: You could decide what you should do without asking someone else. 

7. Social Status 

Form P: I could be ’’somebody” in the community 

Revision: You could be somebody important in your neighborhood 

8. Supervision-Human Relations 

Form P: My boss would back up his met* (with top' management) . 

Revision: Your boss would stick up for his men 

9. Working Conditions 



Form P: The job would have good working conditions. 

Revision: The place where you work would be clean, bright and comfortable. 

The results of the application of the readability formulas to these nine 
reworded item stems are shown in Table 34. As Table 34 shows, the attempt at 
rewriting the item stems at a lower readability level was successful in all but 
two instances, Creativity and Recognition. 
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Table 34 

Dale-Chall and Flesch readability scores for 



standard and revised Item-stem wordings, by scale 



Scale 


" Dale-Chall' 1 . 


A ~* T 


Flesch* 




Form P 


Revision 


Form P Revision 


1. Ability Utilization 


5.7 


4.2 


78 


95 


2. Achievement 


5.8 


4.0 


76 


85 


3. Creativity 


4.1 


4.3 


100 


93 


4. Moral Values 


5.5 


4.1 


82 


86 


5. Recognition 


5.8 


5.6 


85 


86 


6. Responsibility 


6.2 


4.2 


91 


59 


7. Social Status 

8. Supervision-Human 


8.4 


4.0 


57 


22 


Relations 


8.8 


4.0 


95 


98 


9. Working Conditions 


6.2 


5.6 


80 


68 



a 

Dale-Chall scores correspond to grade ' level . 
b 

Flesch scores are interpreted as follows: 



0-30 


College 


Very difficult 


30-50 


High school or 






sane college 


Difficult 


50-60 


Some High . 






school 


Fairly difficult 


60-70 


7th-8th grade 


Standard 


70-80 


6th grade 


Fairly easy 


80-90 


5th grade 


Easy 


90-100 


4th grade 


Very easy 



t 

k 

i 

> 

\ 
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MIO Study 5 

Equivalence of Form M, Form MRev and Form P 



Purpose 

This study was undertaken to investigate the equivalence of three forms of 
the MIO; the standard form (Form P) and two forms constructed for use with 
the mentally retarded (Form M and Form MRev). The latter two forms differ 
only on the nine scales whose item stems were reworded in the preceding 
study* Form MRev contains the revised item wording resulting from MIQ Study 4 
As in the previous equivalence study, the focus of interest in this study is 
on profile equivalence. 



Method 

Subjects — subjects were drawn from the experimental psychology subject 
pool at the University of Minnesota. These were, for the most part, college 
sophomores in the College of Liberal Arts. 



Procedure- - Subjects were randomly assigned to one of the following five 
experimental groups: 

First Second 



Group 


Administration 


Administration 


N i 


Group I 


Form P 


Form M 


34 


Group II 


Form M 


Form P 


34 


Group III 


Form P 


Form P 


42 


Group IV 


Form P 


Form MRev 


30 


Group V 


Form MRev 


Form P 


30 



Each individual was administered the designated forms of the MIQ in an 



Immediate test-retest paradigm. Order of administration of two different 



forms was controlled by transposing the order of administration of the forms. 



Analysis — Because of the availability, at the time of this study, of 



Occupational Reinforcer Patterns (ORPs) for 81 occupations, it was possible 
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to use this information in the determination of profile equivalence among 
forms. Each subject's MIQ profile was compared with each of the 81 ORPs. 

These 81 ORPs were then ranked in order from most to least correspondence 
with the subject’s 11IQ profile. Profile equivalence between any two forms 
was examined by two methods. 

1) For each subject, an agreement percentage between the two forms was 
computed for the top 20 ranked ORPs and for the bottom 20 ranked ORPs. 

The average of these two agreement percentages was also calculated. 

2) For each subject, the rank order correlation between the ORP rankings 
resulting from each form was calculated. The product moment correlation 
between the correspondence scores for each form was also calculated. The 
same procedures were followed for the ranking of correspondence and 
correspondence scores, using 9 ORP occupational cluster profiles instead 
of the 81 ORPs. 

Median tents and t- tests contrasted the agreement percentages and correlations 

for the groups. A scale-by-scale comparison of the three forms was also 

\ _ 

conducted,. Correlations were computed for each test-retest administration. 
Results 

No order effects were observed, thereby allowing the combining of Group I 
and Group II data (P-M data) and also that of Groups IV and V (P-HRev data). 
Median tesits of the distribution differences were conducted on the combined 
groups data, the results being summarized in Table 35. Table 35 shows that 
both Forms M and MRev were not sufficiently equivalent to Form P to pass 
all the tests to which they were subjected. Neither does Table 35 provide 
conclusive evidence for the superiority of one form over the other (i.e.. Form M 
76 vs Form MRev) . While Form MRev does better on the correlational analyses , it 



